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Substance of Interview including description of the general nature of what was agreed to if an agreement was 
reached, or any other comments: It was agreed that the proposed amendments overcome the current 112 second 
paragraph rejections. Allowability of claims was not agreed upon because the examiner has determined that some of 
the proposed claims would reguire further search . 

(A fuller description, if necessary, and a copy of the amendments which the examiner agreed would render the claims 
allowable, if available, must be attached. Also, where no copy of the amendments that would render the claims 
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Dear Examiner Motsinger: 

[0001] This communication provides an agenda for a phone interview 
of this matter. My assistant will be contacting you to schedule an interview. 
If you would prefer to schedule the interview, then please contact my 
assistant or me directly. Our contact info is on the signature page of this 
document. Thank you in advance for talking with me about this matter. 
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Interview Agenda: 

• Discussion of current §112 rejections; and 
■ Discussion of proposed amendments 

Section 112 

[0002] I would like to discuss whether or not proposed amendments to 
claiml4 would overcome the current §112 rejections regarding the use of 
the term "fuzzy growing". Claim 14 is dependent of independent claim 8 
which has been amended to incorporate the allowable subject matter of 
claim 15 that describes "fuzzy growing". 

Proposed Amendments 

[0003] Please see the attached Appendix of Proposed Claim 
Amendments. I would like to discuss your opinion regarding the proposed 
amendments in light of the currently cited references. Please notice that all 
independent claims have been amended to incorporate the allowed subject 
matter of claim 15. 
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[0004] Thank you in advance for scheduling time for this interview. I 
look forward to talking to you. 



Respectfully Submitted, 



Dated: January 16, 2008 By: 

E. John Fain 
Reg. No. 60960 
(509) 324-9256 X256 
johnf@leehayes.com 
www.leehayes.com 



My Assistant: Carly Bokarica 
(509) 324-9256 x264 
cariy@leehayes.com 
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Appendix of Claims with Proposed Amendments 

1. (Currently Amended) A method for modeling image 
attention, the method comprising: 

preprocessing an image to generate a quantized set of image 
blocks; and 

generating a contrast-based saliency map for modeling one-to-three 
levels of image attention from the quantized image blocks : and 

performing a fuzzy growing operation to extract attended areas from 
the contrast-based saliency map, the fuzzy growing operation comprising: 

partitioning the contrast-based saliencv map into two mutually 
exclusive areas as a function of classes of pixels comprising 
attended and unattended pixel areas; 

selecting seeds for the fuzzy growing operation according to a 
set of criteria such that a seed has a local maximum contrast with 
respect to other regional perception units and the seed belongs to 
an attended area: 

grouping pixels in the contrast-based saliency map with gray 
levels that satisfy criteria that indicate attended as compared to 
unattended areas; and 

iteratively growing the attended area by using grouped pixel 
as seeds in subsequent fuzzy growth operations until no candidates 
of the perception units can be grouped . 

Iee@hayes The Business of IP 

www.leehBye3.oom 509.324.9256 

4/14 * RCVD AT 1/16/2008 1 1 :48:49 PM [Eastern Standard Time] * SVR:USPTO-EFXRF-5/40 * DNIS:2702237 * CSID: 15092672653 * DURATION (mm-ss):09^6 



To: 



Page 5 of 14 



2008-01-17 04:48:37 (GMT) 



15092672653 From: Lee & Hayes 



INFORMAL COMMUNICATION: Please do not put in the file 

2. (Previously Presented) The method of claim 1, 
wherein preprocessing further comprises: 

resizing the image such that an aspect ratio of the image is 
maintained; 

transforming the image from a first color space to a second color 
space that is consistent with human perception; and 

making color in texture areas of the image coarser. 

3. (Previously Presented) The method of claim 1, 
wherein generating the contrast-based saliency map further comprises: 

dividing the image subsequent to quantization into multiple 
perception units; and 

calculating a respective contrast of color components for each 
perception unit; and 

normalizing calculated contrasts to smooth the contrasts. 

4. (Previously Presented) The method of claim 1, further 
comprising extracting attended points from the contrast-based saliency 
map. 

5. (Previously Presented) The method of claim 1, further 
comprising extracting an attended area from the contrast-based saliency 
map. 
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6. (Previously Presented) The method of claim 1, further 
comprising extracting an attended view from the contrast-based saliency 
map. 

7. (Currently Amended) A computer- readable medium storing 
computer-program Instructions executable by a processor for modeling 
image attention, the computer-program instructions when executed by the 
processor performing operations comprising : 

preprocessing an image to generate a quantized set of image 
blocks; and 

generating a contrast-based saliency map for three-level contrast- 
based image attention analysis from the quantized image blocks ; and 

performing a fuzzy growing operation to extract attended areas from 
the contrast-based saliency map, the fuzzy growing operation comprising; 

partitioning the contrast-based saliency map into two mutually 
exclusive areas as a function of classes of pixels comprising 
attended and unattended pixel areas: 

selecting seeds for the fuzzy growing operation according to a 
set of criteria such that a seed has a local maximum contrast with 
respect to other regional perception units and the seed belongs to 
an attended area; 

grouping pixels in the contrast-based saliency map with gray 
levels that satisfy criteria that indicate attended as compared to 
unattended areas; and 

iterativelv growing the attended area by using grouped pixel 
as seeds in subsequent fuzzy growth operations until no candidates 
of the perception units can be grouped . 
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8. (Currently Amended) A computer-readable medium storing 
computer-program instructions executable by a processor, the computer- 
program instructions when executed by the processor for modeling image 
attention by operations comprising: 

generating a preprocessed image by: 

resizing the image such that an aspect ratio of the image is 

maintained; and 

if the image is not already in a color space that is consistent 

with human perception, transforming the image from a first color 

space to a second color space that is consistent with human 

perception; 

quantizing the preprocessed image to generate quantized image 
perception units such that color in texture areas across the quantized 
image perception units are coarser as compared to the image; and 

generating a contrast-based saliency map from the quantized image 
blocks, the contrast-based saliency map comprising a respective contrast 
of color components for each perception unit : and 

performing a fuzzy growing operation to extract attended areas from 
the contrast-based saliency map, the fuzzy orowino operation comprising: 
partitioning the contrast-based saliency map into two mutually 

exclusive areas as a function of classes of pixels comprising 

attended and unattended pixel areas: 

selecting seeds for the fuzzy orowino operation according to a 

set of criteria such that a seed has a local maximum contrast with 

respect to other regional perception units and the seed belongs to 

an attended area; 

grouping pixels in the contrast-based saliency map with gray 

levels that satisfy criteria that indicate attended as compared to 

unattended areas: and 

iterativelv growing the attended area by using grouped pixel 

as seeds in subseguent fuzzv growth operations until no candidates 

of the perception units can be grouped . 
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9. (Previously Presented) The computer-readable medium of 
claim 8, wherein the computer-program instructions further comprise 
instructions for extracting attended points from the contrast-based saliency 
map. 

10. (Previously Presented) The computer-readable medium of 
claim 8, wherein the computer-program instructions further comprise 
instructions for extracting an attended view from the contrast-based 
saliency map. 

11. (Previously Presented) The computer-readable medium of 
claim 8, wherein the computer-program instructions further comprise 
instructions for extracting an attended view from the contrast-based 
saliency map, the attended view being a rectangle V(Q W, H), where C 
denotes an attention center, and W and H are the width and height of 
rectangle respectively, the attention center being a centroid of the 
contrast-based saliency map. 

12. (Previously Presented) The computer-readable medium of 
claim 8, wherein the computer-program instructions further comprise 
instructions for determining a size of an attended view in the contrast- 
based saliency map, the size being related to a 1st order central moment 
of the contrast-based saliency map. 
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13. (Previously Presented) The computer-readable medium of 
claim 8, wherein the computer-program instructions further comprise 
instructions for extracting an attended area from the contrast-based 
saliency map. 



14. (Currently Amended) The computer-readable medium of 
claim 8, wherein the computer-program instructions further comprise 
instructions for extracting attended areas from the contrast-based saliency 
map by performing [[a]] tiie fuzzy growing operation on the contrast- 
based saliency map as a function of two classes of pixels to partition the 
contrast-based saliency map into two mutually exclusive areas, the two 
classes of pixels comprising attended and unattended pixel areas. 

15. (Canceled) The computer-readable medium of claim 8, 
wherein the computer-program instructions further comprise instructions 
for: 

performing a fuzzy growing operation to extract attended areas from 
the contrast-based saliency map, the fuzzy growing operation comprising: 

partitioning the contrast-based saliency map into two mutually 
exclusive areas as a function of classes of pixels comprising attended and 
unattended pixel areas; 

selecting seeds to for the fuzzy growing operation according to a set 
of criteria such that a seed has a local maximum contrast with respect to 
other regional perception units and the seed belongs to an attended area; 

grouping pixels in the contrast-based saliency map with gray levels 
that satisfy criteria that indicate attended as compared to unattended 
areas; and 

iterativeiy growing the attended area by using grouped pixel as 
seeds in subsequent fuzzy growth operations until no candidates of the 
perception units can be grouped. 
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16. (Previously Presented) The computer-readable medium of 
claim 8, wherein the computer-program instructions further comprise 
instructions for representing the contrast-based saliency map as a fuzzy 
event in probability space to extract attended areas. 

17. (Previously Presented) The computer-readable medium of 
claim 16, wherein the contrast-based saliency map 216 has L gray levels 
from gb to g L . x and the histogram of saliency map is h h k=0, L-l, and 
wherein the computer-program instructions further for representing the 
contrast-based saliency map as a fuzzy event in probability space further 
comprise instructions for: 

modeling the contrast-based saliency map by a triplet (ft, k, P), 
where Sl={ go, 9\, g L -\} and P is a probability measure of the 
occurrence of gray levels, i.e., Pi{gi<} = />j/Z/fr; 

denoting a membership function fj^gfi of a fuzzy set SeSl indicating 
a degree of properties comprising attended areas possessed by gray level 
9k) and 

representing the properties as a fuzzy event as follows: 

S= Z M&y^and 
computing a probability of the fuzzy event by: 

P(S)=ZMSk)Pr(gk) ■ 

k=0 
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18. (Currently Amended) A computing device for modeling 
image attention, the computing device comprising a processor coupled to 
a memory, the memory comprising computer computer-program 
instructions executable by the processor for: 

quantizing a preprocessed image to generate quantized image 
perception units such that color in texture areas across the quantized 
image perception units are coarser as compared to the image, the 
preprocessed image being a resized version of the image with an original 
aspect ratio and in a color space consistent with human perception; and 

generating a contrast-based saliency map from the quantized image 
blocks, the contrast-based saliency map comprising a respective contrast 
of color components for each perception unit : and 

performing a fuzzy growing operation to extract attended areas from 
the contrast-based saliency map, the fuzzy growing operation comprising: 
partitioning the contrast-based saliency map into two mutually 

exclusive areas as a function of classes of pixels comprising 

attended and unattended pixel areas: 

selecting seeds for the fuzzy growing operation according to a 

set of criteria such that a seed has a local maximum contrast with 

respect to other regional perception units and the seed belongs to 

an attended area: 

grouping pixels in the contrast-based saliency map with gray 

levels that satisfy criteria that indicate attended as compared to 

unattended areas: and 

iterativelv growing the attended area by using grouped pixel 

as seeds in subseguent fuzzy growth operations until no candidates 

of the perception units can be grouped . 
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19. (Previously Presented) The computing device of claim 18, 
wherein the computer-program instructions further comprise instructions 
for extracting attended points from the contrast-based saliency map. 

20. (Previously Presented) The computing device of claim 18, 
wherein the computer-program instructions further comprise instructions 
for extracting an attended area from the contrast-based saliency map. 

21. (Previously Presented) The computing device of claim 18, 
wherein the computer-program instructions further comprise instructions 
for extracting an attended view from the contrast-based saliency map. 
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22. (Currently Amended) A computing device comprising: 

means for preprocessing an image to generate a quantized set of 
image blocks; and 

means for generating a contrast-based saliency map for modeling 
three-levels of image attentions from the quantized image blocks : and 

means for performing a fuzzy growing operation to extract attended 
areas from the contrast-based saliency map, the fuzzy growing operation 
comprising: 

partitioning the contrast-based saliency map into two mutually 
exclusive areas as a function of classes of pixels comprising 
attended and unattended pixel areas: 

selecting seeds for the fuzzy growing operation according to a 
set of criteria such that a seed has a local maximum contrast with 
respect to other regional perception units and the seed belongs to 
an attended area: 

grouping pixels in the contrast-based saliency map with gray 
levels that satisfy criteria that indicate attended as compared to 
unattended areas: and 

iteratively growing the attended area by using grouped pixel 
as seeds in subseguent fuzzy growth operations until no candidates 
of the perception units can be grouped . 
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23. (Previously Presented) The computing device of claim 22, 
wherein the means for generating the contrast-based saliency map further 
comprises: 

means for dividing the image subsequent to quantization into 
multiple perception units; and 

means for calculating a respective contrast of color components for 
each perception unit; and 

means for normalizing calculated contrasts to smooth the contrasts. 

24. (Previously Presented) The computing device of claim 22, 
further comprising means for extracting attended points from the contrast- 
based saliency map. 

25. (Previously Presented) The computing device of claim 22, 
further comprising means for extracting an attended area from the 
contrast- based saliency map. 

26. (Previously Presented) The computing device of claim 22, 
further comprising means for extracting an attended view from the 
contrast-based saliency map. 
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